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ENUMERATION OF PERMUTATIONS CONTAINING A 
PRESCRIBED NUMBER OF OCCURRENCES OF A 
PATTERN OF LENGTH 3 

MARKUS FULMEK 

Abstract. We consider the problem of enumerating the permu¬ 
tations containing exactly k occurrences of a pattern of length 3. 

This enumeration has received a lot of interest recently, and there 
are a lot of known results. This paper presents an alternative ap¬ 
proach to the problem, which yields a proof for a formula which 
so far only was conjectured (by Noonan and Zeilberger). This ap¬ 
proach is based on bijections from permutations to certain lattice 
paths with “jumps”, which were first considered by Krattenthaler. 


1. Introduction 


1.1. Patterns in permutations. We consider the group Sn of per¬ 
mutations of the set {1,..., n}. Let r be an arbitrary permutation in 
<Sk {k > 2, in order to avoid trivial cases). We say that some permu¬ 
tation p = (pi, ... ,Pn) G Sn contains the pattern r, if there exists a 
subword a = (pij,..., in p, such that the entries of the subword a 
appear in the same “relative order” as the entries of the permutation 
r. More formally stated, the subword a can be transformed into the 
permutation r by the following construction. Replace the smallest ele¬ 
ment in cr by 1, the second-smallest by 2, the third-smallest by 3, and 
so on. 

li p E Sn does not contain pattern r, we say that p is r-avoiding. 

For example, the permutation p = (1, 5, 2,4, 3) contains the pattern 
r = (3,1,2), since the subword a = {p2, pz, Pa) = (5,2,4) shows the 
same relative ordering of elements as r. First comes the largest element 
(i.e., 5), then the smallest (i.e., 2), and then the second-largest (i.e., 

4 )- 

The enumeration of the set 5„(r, r) of permutations from Sn, which 
contain the hxed pattern r precisely r times, has recently received 
considerable interest [|, 0, |, |, §, 0, |, 0, |g, 0, 0, 0, [g, [^, 

g, g, |g,g. 
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Figure 1. Graphical illustration. Permutation 
(1, 5, 2,4, 3) contains exactly 2 (3,1, 2)-patterns. 
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In our above example p = (1,5, 2,4, 3), the pattern (3,1,2) occurs 
exactly twice, since the subword a = (p 2 ,P 3 ,P 5 ) = (5,2,3), too, shows 
the same relative ordering as (3,1,2). Hence (1,5, 2,4, 3) belongs to 
55((3,1,2),2). 

We shall denote the cardinality of iS„(r, r) by Sn(u, r), where we set, 
by convention, So(t, 0) = Si(r, 0) = 1 and Sq{t, r) = Si(r, r) = 0 for 
r > 0 (recall that r is of length at least 2). We denote the generating 
function of these numbers by Fr^r{,x) ;= ^n(T, r) x” 

1.2. Outline of this paper. In this paper, we consider patterns of 
length 3. It is well known that there are only two patterns in ^3 which 
are essentially different, namely (3,2,1) and (3,1,2). (We shall give a 
simple argument for this fact right below). For both of these patterns, 
we make use of a bijective construction which basically “translates” 
permutations into certain “generalized” Dyck-paths, where “jumps” 
are allowed. This construction was first considered by Krattenthaler 
Lemma 0 and Lemma T]. Using the well-known generating func¬ 
tion for Dyck-paths, we are able to obtain the generating functions 
-^( 3 , 1 , 2 ),r( 2 ^) and F (3 2 ,i),r(a;) for r = 0,1, 2 in a uniform way. Especially, 
for r = 0 we thus obtain a very simple “graphical” proof of the for¬ 
mulas for s„((3,1,2), 0) and s„((3,2,1), 0) (which, of course, are very 
well known, see p2| . Exercises 6.19.ee and 6.19.ff]). The derivation of 
-^( 3 , 2 , 1 ), 2 ( 2 ^) seems to be new (it was conjectured by Noonan and Zeil- 
berger |]T7|). 

In Section ^ we present the respective formulas. In Section]^ we intro¬ 
duce the bijective construction and show how the generating functions 
can be derived. 



1.3. Graphical approach to permutation patterns. “Graphical 
arguments” play a key role in our presentation. We introduce the 
permutation graph G (p) (see p. 71]) as a simple way for visualizing 
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some permutation p G Sn- 

G{p) := {(l,pi),...,(n,p„)} C n} X n}. 


Figure |l| illustrates this concept. The set {1,... ,n} x {1,... ,n} is 
visualized by a rectangular grid of square cells, the elements {i, pi) of 
the graph are indicated by dots in the respective cell. Note that the two 
(3,1,2)-patterns in (1,5, 2,4, 3) appear as “hook-like conhgurations”, 
as indicated by the arrows in the picture. 

Clearly, G (p) is just another way to denote the permutation p. 
Hence, in the following we shall not make much difference between 
a permutation and its graph. 

We call the “horizontal line” ..., {n,i)} the i-th row of the 

graph, and the “vertical line” {(j, 1),..., (j, n)} the j-th column of 
the graph. Note that the rows of G (p) correspond to the rows of the 
permutation matrix of p in reverse order. Clearly, each row and each 
column of the graph of some permutations contains precisely one dot. 

A simple geometric argument now shows that, when talking about 
patterns of length 3, we may restrict our attention to 2 “essentially dif¬ 
ferent” patterns, namely (3,2,1) and (3,1,2). Given the permutation 
graph of an arbitrary permutation r, consider the rotations by 0, |,7r 
and Clearly, every pattern contained in r is rotated accordingly, so 
the numbers s„(r, r) are the same as the numbers Sn('^^ r), where t' 
denotes the permutation obtained by rotating the graph of r. There¬ 
fore, we only have to consider the different orbits of the permutation 
graphs of S 3 under the action of this rotation group. It is easy to 
see that there are precisely two of them, one containing (3,1,2) (see 
Figure |), the other containing (3, 2,1) (see Figure |^). 

2. Results and conjectures 

2.1. Formulas for 0,1, and 2 occurrences of pattern r. In the 

following, we summarize the formulas and generating functions we are 
going to prove later. We start with a very well known fact: 



( 1 ) 


These are the Catalan numbers, which go like this: 1, 1, 2, 5, 14, 42, 
132, 429, 1430, 4862, 16796, 58786, 208012, .... The corresponding 
generating function is 
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Figure 2. Graphical illustration of the orbit of (3 ,15 2) 
under rotations of the permutation graph 



Figure 3. Graphical illustration of the orbit of (3, 2,1) 
under rotations of the permutation graph 



The next formula was hrst proved by Bona 0]: 

s„((3,l,2), (3) 

The numbers go like this: 0, 0, 0, 1, 5, 21, 84, 330, 1287, 5005, 19448, 
75582, 293930, .... The corresponding generating function is 

f’p.ia.iW = ^ - (4) 


The next formula was first proved by Mansour and Vainshtein 


|TT| 


Sn((3,l,2),2) 


2 n — 6 \ + 17n^ — 80n + 80 

n — A ) 2n{n — 1) 


(5) 
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The numbers go like 0, 0, 0, 0, 4, 23, 107, 464, 1950, 8063, 33033, 
134576, 546312, .... The corresponding generating function is 

„ . . + 3t - 2 

F{3,1,2),2{x) — --- 


2x* — + 29a;^ — 15a; + 2 


(1 - 4a;) 


( 6 ) 


Remark 1. Mansour and Vainshtein [^, Corollary 3] are able to com¬ 
pute the numbers s„((3,l,2), r) and generating functions F(^ 3 ^i^ 2 ),r{x) 
for r up to 6. 


The next formula was first proved by Noonan [pT 
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s„((3,2,l), 1) = 


2n 


(7) 


n\n — 

These numbers go like 0, 0, 0, 1, 6, 27, 110, 429, 1638, 6188, 23256, 
87210, 326876, .... The corresponding generating function is 

^ , . 2a;^ — 9x^ + 6a; — 1 \/l — 4x(3x‘^ — 4x + 1) 

F,3.2.iuW =---. (8) 

The next formula was conjectured by Noonan and Zeilberger |j^; to 
the best of my knowledge the first proof is contained in this paper: 

59^2 + 117n + 100 / 2n 


Sn{{3,2,l),2) = 


(9) 


2n{2n — 1) (n + 5) \n — AJ 

These numbers go like 0, 0, 0, 0, 3, 24, 133, 635, 2807, 11864, 48756, 
196707, 783750, .... The corresponding generating function is 

5x^ — 7x‘^ + 17x^ — 20a;^ + 8x — 1 


F{3,2,1),2{x) — 


2 x^ 

\/l — Ax(x^ — 3x'^ + 5a:^ — lOx^ + 6a; — 1) 
2 x^ 


. ( 10 ) 


Remark 2. Toufik Mansour informed me that he found a proof of 
formula too. 

2.2. Further conjectures. We state the following conjectures con¬ 
cerning generating functions. 

Conjecture 3. The generating function ^( 3 ^ 2 , 1 ), 3 ( 2 ;) is 

(-1 + 10a; - 33a;2 + 32a;3 + 31a;^ - 70^*^ + 35x® - 2a;®) 


7^(3,2,1), 3(3^) - 


2x'^ 


\/l — 4a;(—1 -I- 8x — 19a;^ -f 6x® -f 27x^ — 28x® -f 7x® -f 2x’^) , . 
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Conjecture 4. The generating function -F(3,2,i),4(^) 


'^(3,2,l),4(^) 


^ [(-1 + 12x - SOx^ + 65x^ + 107x^ - 437x® + 588x^ 
2x^ 

- 492x^ + 314x® - 108x^ + 3x^°) 


+ Vl - 4 x(-1+10x-32x2+17x^+107x^-245x^+256x®-192x^+102x® 

-18x^-x^°)]. (12) 


2.3. General form of the formulas. By inspection of the formnlas 
listed above, one is immediately led to conjecture a simple general form 
for the generating functions F( 3 ,i, 2 ),r(a^) and i^( 3 , 2 ,i), 2 (a^)- The “(3,1, 2)- 
part” was proved by Bona |^, Proposition 1 and Lemma 3]. 

Theorem 5 (Bona). The generating functions F{^^i^ 2 ),r{x) are rational 
functions in x and a/1 — 4x. Moreover, when written in smallest terms, 
the denominator of F^ 3 ^i^ 2 ),r{x) is egual to (a/1 — 4x) 

For the “(3,2, l)-part”, we state the following conjecture: 


Conjecture 6. The generating functions F(^ 3 ^ 2 ,i),r{x) is of the form 

{Pr (x) + Vl-AxQr (x)) , 
where Pr and Qr are polynomials. 


Remark 7. Toufik Mansour |]^ informed me that he found a proof 
for the general form of the generating function F(^ 3 ^ 2 ,i),r{x). 


3. The proofs 


3.1. The case of pattern—avoidance. Let us start with a simple 
proof of (2). Recall that the Catalan numbers Cn arise in the enumer¬ 
ation of Dyck paths, which are paths in the integer lattice consisting of 
“up-steps” (1,1) and “down-steps” (1,-1), which start in (0,0) and 
end at (2n, 0), such that the path never goes below the horizontal axis. 
More precisely, we have 

1 /2n\ 

Cn = -( ] = # of Dyck-paths from (0, 0) to (2n, 0). 

n -|- 1 \ n / 

So (|l]) will follow, if we can establish a bijection between permuta¬ 
tions in Sn which do avoid the pattern (3, 2,1) or (3,1, 2), respectively, 
and Dyck-paths from (0, 0) to (2n, 0). Denote the set of such paths by 


In the following, r will always denote one of the patterns (3,1, 2) or 
(3, 2,1). If some assertion A is valid for both patterns, we shall simply 
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say “A is valid for r” instead of “A is valid for (3,1, 2 ) and for (3, 2 , 1 )”. 
For an entry pi in some permntation p = (pi,..., p„) G Sn, we call the 
entries pj with j < i the entries to the left, and with j < i the entries 
weakly to the left, and likewise for entries (weakly) to the right. 

Definition 8. Let p = (pi,..., p„) G Sn be an arbitrary permutation. 
An entry pi is called a left-to-right maximnm, if pi is greater than all 
entries to the left of it; i.e., if pi > pj for all j < i. Entries which are 
not left-to-right maxima are called remaining entries. 


Observation 9. By definition, for a subword (ai, <72, as) in p which 
establishes an occurrence of the pattern r, neither entry a 2 nor can be 
a left-to-right maximum in p. On the other hand, the entry cxi is either 
a left-to-right maximum itself, or there is a left-to-right maximum p^ 
to the left of ai, such that (pfc, <72, as) gives another r-occurrence. In 
fact, this is the case for all left-to-right maxima pk weakly to the left 
of a 2 , such that pk > max (( 72 , < 73 ). 

To establish onr desired bijections, we first consider a single mapping 

V’ • Sn ^ Dn, 

which will tnrn ont to yield both bijections for r = (3, 2,1) and r = 
(3,1, 2) by simply restricting to Snij, 0). is defined by the following 
“graphical” constrnction: For an arbitrary permntation p ^ Sn, 

• draw the permntation graph of p and mark the left-to-right max¬ 
ima (i.e., the points (z, pi) with pi > pj for all j < i), 

• consider the points {x,y) G {1,..., n}x{l,..., n}, which lie below 
and to the right of some left-to-right maximnm (i.e., x > i and 
y < Pi for some left-to-right maximnm {i,pi)), 

• rotate the “polygonal hgnre” formed by these points by — ^ and 
consider its npper bonndary, which appears as some path p from 
( 0 , 0 ) to ( 2 n, 0 ), 

• set if (p) = p. 

Figure | gives an illustration of this construction. The left-to-right 
maxima are marked by circles, the boundary line of the polygonal hgnre 
is shown as bold line, and the corresponding path is drawn below. Note 
that the entries of the permutation correspond to the down-steps of the 
path (this correspondence is indicated by the labels in Figure H); the 
left-to-right maxima of the permutation correspond to the “peaks” of 
the path. In the following, we will more or less identify the z-th entry 
of p and the Ath down-step of (p). 


MARKUS FULMEK 


Figure 4. Illustration of the mapping if) from per¬ 
mutations to Dyck-paths. (Note: The permutation 
(3, 6, 5,4, 8, 2,10, 9, 7,1) is (3,1, 2)-avoiding.) 



We have to show that the resulting path p = {p) is actually in 

Dm i.e., p does not go below the horizontal axis. For convenience, we 
introduce some notation concerning paths. 

Definition 10. A down-step from {x,h + l) to {x + l,h) is said to 
have (or he of) height h. By abuse of notation, we will also say that the 
entry of the permutation corresponding to such down-step has height 
h. 

The i-th down-step in t) (p) corresponds to the i-th entry of p. There 
must exist left-to-right maxima pj weakly to the left of this entry (i.e., 
j < i). We call the right-most of these the preceding left-to-right 
maximum with respect to the down-step; it corresponds to the peak 
weakly to the left of the down-step. 

So what we have to show is that all down-steps have nonnegative 
heights. First note that the height of a left-to-right maximum p^ is 





PATTERNS IN PERMUTATIONS 


9 


exactly the number of entries to the right which are smaller; i.e., 

: m < j < n and pj < pm], 

which clearly is nonnegative. More generally, let hk be the height of the 
/c-th down-step, and let pm be the preceding left-to-right maximum 
of height hm- It is easy to see that = hm — {k — m), which is 
nonnegative, too, since {k — m) cannot exceed hm- Hence p = 'ip {p) is 
indeed in Dn for all p E Sn- 

Next we show that the mapping -0, restricted to 5„(r, 0), is a bijec- 
tion, for r = (3,2,1) as well as for r = (3,1,2). Thus (P will follow 
immediately. Given an arbitrary Dyck-path p in Dn, we will construct 
a permutation p E Sn such that 

• 0 (p) = p, 

• p is the unique r-avoiding permutation in 0“^ (p). 

We start by rotating path p by thus obtaining a “conhguration of 
left-to-right maxima”, which we may view as an “incomplete permu¬ 
tation graph”. 

While there are empty rows and columns in this “incomplete graph”, 
repeat the following step for the case r = (3,2,1): 

Consider the left-most column j, which does not yet contain 
a dot, and the lowest row i, which does not yet contain a 
dot, and put a dot into the cell 

Observe that a permutation obtained from this construction is (3,2,1)- 
avoiding. Figure ^ illustrates this construction for the “configuration 
of left-to-right maxima” from Figure P 

For the case r = (3,1, 2), repeat the following step: 

Consider the left-most column j, which does not yet contain 
a dot, and the highest row i, which does not yet contain a dot 
and which lies below the preceding left-to-right maximum, 
and put a dot into the cell {i,i). 

Observe that a permutation obtained from this construction is (3,1,2)- 
avoiding, as is illustrated by Figure H 

These constructions will give completed graphs (and thus some per¬ 
mutation p) in any case; however, in order to have 0 (p) = p, there 
must hold the following condition: 

Whenever there is a column j which does not yet contain 
a dot, then there is also some row i without a dot, which 
lies below the left-to-right maximum preceding (in the same 
sense as before) column j. 

But this is precisely the condition, that the path p does not go below 
the horizontal axis. 
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Figure 5. Illustration of the mapping ^|J from per¬ 
mutations to Dyck-paths. (Note: The permutation 
(3, 6,1, 2, 8,4,10, 5, 7, 9) is (3, 2, l)-avoiding.) 
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The fact that the permutation p is indeed unique is best seen “by in¬ 
spection” , see Figures ^ (for (3,1, 2)-avoiding permutations) and ^ (for 
(3, 2, l)-avoiding permutations). Consider an arbitrary “conhguration 
of left-to-right maxima” and observe: 

• If a permutation is (3,1, 2)-avoiding, the “remaining elements” 
must be inserted in a “descending” way, 

• if a permutation is (3, 2, l)-avoiding, the “remaining elements” 

must be inserted in an “ascending” way. □ 

3.2. Krattenthaler’s bijections. The bijective proof for the case of 
zero occurrences of length-3-patterns was very simple. While the for¬ 
mal description of the constructions took some pages of text, the main 
idea is easily obtained by mere “inspection” of Figure | and Figure |^. 
This “graphical view” will turn out to be fruitful also for the cases of 
one and more occurrences of patterns; however, we do not have such a 
simple and uniform “graphical” dehnition any more. We now have to 
distinguish between the case of (3, 2, l)-patterns and (3,1, 2)-patterns. 
The respective constructions were given by Krattenthaler [Q. 

Definition 11. Consider the set of lattice paths from (0,0) to {2n -|- 
s,0), consisting of {n + s) up-steps (1,1), n down-steps (1,-1), and 
s down-jumps (0,-1), which do never go below the horizontal axis. 
Denote this set of “generalized Dyck-paths with down-jumps” by Dn,s, 
denote the union IJ^o ^ri,s by D'^ and the union U“o^n by D'. 
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A maximal seqence of d consecutive down-jumps is called a jump of 
depth d. 


Such paths with jumps will be the main object of the following con¬ 
siderations. We will refer to them simply as “lattice paths” or (even 
simpler) as “paths”. In order to avoid complicated verbal descriptions 
of such paths (or segments of paths), we introduce a “graphical nota¬ 
tion” by denoting an up-step by /, a down-step by \, and a down-jump 
by P. For illustration, see Figure The two Dyck-paths with jumps 
shown there read ////\\/\l\/\l and ////\||\///\\\ , respectively, 
in this “graphical notation”. 

For specifying the length of some sequence of consecutive steps, we 
introduce a notation by means of example: \ “^ • \ denotes a sequence 
of k downsteps. A down-step of height h (in the sense of Dehnition IM 


is denoted by ^ 


Definition 12. Define the mapping 

■ Sn^ D'^ 

by the following construction: Read p = (pi ,..., Pn) £ Sn from left to 
right and define the height hi to he the number of elements pk which are 
smaller than pi and lie to the right of i, i.e., with k > i and pk < pi- 
It is clear that this amounts to another unique encoding of the per¬ 
mutation p by a “height-vector” (hi,..., h„). This height-vector is 
translated into a path in the following way. 

Start at (0, 0). 

For i = 1,... ,n do the following: 

If the last point of the path constructed so far lies 
below hi-\-l, then draw as many up-steps as necessary 
to reach height hi -|- 1, otherwise make as may down- 
jumps as necessary to reach height hi + 1. 

Finally, draw a down-step at height R. 

For the resulting lattice path p, set i/’( 3 ,i, 2 ) (p) = P- 

It is easy to see that is a well-dehned injection. 

Definition 13. Define the mapping 

'*(’( 3 , 2 , 1 ) : <^n ^ D'n 

by the following construction: Read p = (pi,... ,Pn) £ Sn from left to 
right and define the height R as follows. 

• IF {^,p^) is a left-to-right maximum, then R is the number of 
elements pk which are smaller than and lie to the right from pi, 
i.e., with k > i and pk < Pi, 
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• ELSE hi is the number of elements pk which are bigger than and 
lie to the right of pi, i.e., with k > i and pk > Pi, and which are 
smaller than the preceding left-to-right maximum. 

The “height-vector” {hi ,..., /i„) is translated into a path in exactly 
the same way as in Definition ||^. For the resulting lattice path p, set 
^( 3 , 2 , 1 ) (P) = P- 


It is easy to see that t/’( 3 , 2 ,i) is a well-defined injection, too. 

See Fignre ^ for an illustration of both injections '*/'( 3 ,i, 2 ) and "0(3,2,i) 
applied to the same permutation (4, 3, 5,1, 2). Note that the entries of 
the permutation correspond to the down-steps of the path, as before. 
Again, we shall more or less identify a permutation and its correspond¬ 
ing path. 

So clearly, our direction to proceed is as follows: 

• Determine the subsets of D' which correspond to permutations 
containing one, two, etc. occurrences of pattern (3, 2,1) or (3,1,2), 
respectively, 

• identify the generating functions for such subsets. 

In order to describe the relevant subsets of paths, we must have a close 
look at the properties of the mappings " 0 ( 3 , 1 , 2 ) and 0 ( 3 , 2 ,i)- 


Observation 14. Let r be one of the patterns (3,1,2) or (3,2,1). 

1. By construction, a jump in 0r (p) must be preceded and followed 
immediately by a down-step; i.e., patterns /I and 1/ are impossi¬ 
ble. If a jump occurs between the i-th and {i -\- l)-th down-step, 
we call it a jump at position i. 

2. For every down-step and for every jump in fjr {p), there must exist 
a preceding left-to-right maximum (in the sense of Definition [7^0 

3. Every left-to-right maximum in permutation p corresponds to a 
“peak /\ ” in the lattice path 0 (p). However, there might be peaks 
in 0 (p) which do not correspond to left-to-right maxima in p (see 
Figure^ for an example). 

4. Every t- occurrence (ai, cr 2 , < 73 ) in permutaion p is associated with 
a jump in 0 (p) .■ ai lies weakly to the left of the jump, 02 and <73 
to the right. 

5. '4>t{p) is an ordinary Dyck-path (i.e., a Dyck-path without any 
down-jump) if and only if p is r-avoiding: Mappings 0r and 0 
coincide, when restricted to r-avoiding permutations, as a second 
look at the proof given in Section \3.1\ shows immediately. 

6 . To the right of an arbitrary down-step of height I in 0^ (p), there 
must be at least I down-steps: This simple statement implies that 
to the right of a jump of depth d, there must be at least d up-steps. 
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Figure 6. Illustration of the bijections V’( 3 , 2 ,i) and 
permutation p = (4,3, 5,1, 2). 
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1 2 3 4 5 

The image of p under ?/^( 3 ,i, 2 ): One jump of depth 1. 



The image of p under 1 /^( 3 , 2 , 1 ): One jump of depth 2. 



Now we investigate the relationship between jumps in (p) and the 
number of r-occurrences in p more closely. 

Lemma 15. Let r G S 3 be one of the patterns (3,1, 2) or (3, 2,1), let p 
he an arbitrary permutation. A jump of depth d at position i in xfr {p), 
which is followed immediately by I (I > 0 by Observation M) con¬ 
secutive down-steps, implies {d ■ 1) r-occurrences of type {pr, Pi+j, Pk), 
where 


• pr is the left-to-right maximum preceding the jump, 

• Pi+j are the entries of p corresponding to the consecutive down- 
steps immediately following the jump (j = 1 ,... , 1 ), 

• pk is one of the d entries of p with k > i which are 

— bigger than pj+i and smaller than pi for r = (3,1,2), 

— smaller than pi+i for r = (3, 2,1). 
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Proof. The statement sounds a bit complicated, but it is easily obtained 
“by inspection”: 

For the case r = (3,1, 2), consider Figure and observe that entry 
9 is the left-to-right maximum preceding the jump, that (2,1) are 
the entries corresponding to the down-steps immediately following the 
jump, and that the entries (4,3) are the 2 entries to the right of the 
jump, which are bigger than the entry following the jump and smaller 
than the entry preceding the jump — in some sense, they “cause” the 
jump of depth 2: The four occurrences of (3,1,2) in Figure as stated 
in the lemma, are (9,2,4), (9,2,3), (9,1,4) and (9,1,3). 

For the case r = (3,2,1), consider Figure and observe that entry 
9 is the left-to-right maximum preceding the jump, that (6,8) are 
the entries corresponding to the down-steps immediately following the 
jump, and that entries (4, 5) are the 2 entries to the right of the jump, 
which are smaller than the entry following the jump — in the same 
sense as above, they “cause” the jump of depth 2. The four occurrences 
of (3,2,1) in Figure H, as stated in the lemma, are (9,6,4), (9,6,5), 
(9,8,4) and (9,8,5). □ 

Corollary 16. For r > 0 and r = (3,1,2) or r = (3,2,1), takes 
the set Sn{T, r) into Us=i® permutation with exactly r oc¬ 
currences of T is mapped to a Dyck-path with at most r down-jumps. 

It is immediately obvious from Figures]^ and ^that the enumeration 
of occurrences associated with some jump, as given in Lemma [^, is 
in general incomplete. Note that down-steps immediately preceding 
a jump obviously add to the number of (3,1, 2)-occurrences, while 
this is not the case for (3, 2, l)-occurrences. To the contrary, we hnd 
additional occurrences of pattern (3,2,1) if there are “not enough” such 
down-steps. 

While the general situation obviously can get quite complicated, we 
state the following extensions to Lemma 0- 

Corollary 17. Let r = (3,1,2), let p he an arbitrary permutation. 
Consider a jump of depth d at position i in ipr {p), which is followed 
immediately by I consecutive down-steps, and which is preceded imme¬ 
diately by m consecutive down-steps including the one corresponding 
to the preceding left-to-right maximum. Such a jump implies {m ■ d-l) 
T-occurrences of type {pi_g+i, pi+j, pk), where 

• Pi-g+i are the consecutive down-steps immediately preceding the 
jump (g = l,...,m), 

• pi+j are the entries of p corresponding to the consecutive down- 
steps immediately following the jump (j = 1,... ,1), 
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Figure 7. Illustration for Lemma |T^ (Note: The per¬ 
mutation (7, 9, 8, 6, 5, 2,1,4, 3) is not (3,1, 2)-avoiding.) 



• pk is one of the d entries of p with k > i which are bigger than 
Pi+i and smaller than pi. 

Proof. In our graphical notation, the situation is as follows: 

/\m \| d.|\. l.\/. 

The assertion is easily obtained “by inspection”, see Figure 0- □ 

By careful inspection, we obtain yet another observation: 

Corollary 18. In the same situation as in Corollary 0, consider the 
left-to-right maxima pi^,..., pi^ to the left of the left-to-right maxi¬ 
mum preceding the jump, pi^rn+i- For each of these, compute the num¬ 
ber Sj of up-steps to the right, which do not correspond to peaks of 
left-to-right maxima and which are to the left of the jump. Let x be 
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Figure 8. Illustration for Lemma |T^ (Note: The per¬ 
mutation (7,1, 2, 9, 3, 6, 8,4, 5) is not (3, 2, l)-avoiding.) 



the smallest index for which Sx < m. Then there are exactly 

r 

d ■ l ■ (m — s^) 

^=x 

T-occurrences of type pi^j, pk), where 

• p^ are the left-to-right maxima as described above (f = x,... ,r), 

• Pi+j are the entries of p corresponding to the consecutive down- 
steps immediately following the jump (j = 1 ,... , 1 ), 

• pk is one of the d entries of p with k > i which are bigger than 
Pi+i and smaller than pi. 

Lemma 19. Let r = (3, 2,1), let p be an arbitrary permutation. Con¬ 
sider the first jump (counted from the left). Assume that this jump 

• occurs at position i in iprip), 

• is of depth d, 
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• and is followed immediately by I consecutive down-steps. 
Consider the left-to-right maxima ,..., pi^ to the left of the jump, 
and their respective heights hi^,... ,hi^. For each of these r left-to- 
right maxima compute the the number sj of down-steps to the right, 
which do not correspond to left-to-right maxima and which are to the 
left of the jump. 

Let X be the smallest index for which 
Then there are exactly 

r 

d-^niin(^i^ -d-Sg,l) 
g=x 

T-occurrences of type {pig, Pi+j, Pk), where 

• pi^ are the left-to-right maxima as above (g = 1,... ,r), 

• pi+j are the entries of p corresponding to the consecutive down- 
steps after the jump (j = 1, ..., min [hig — d — Sg,l)), 

• pk are the d entries of p with k > i which are smaller than pi+i. 

Proof. The statement sonnds rather complicated, bnt again, it is easy 
to obtain “by inspection” — see Fignre There, we have d = 1 and 
I = 4. The 5 left-to-right maxima preceding the hrst (and only) jnmp 
are 6, 8, 10, 11 and 14; with heights 5, 5, 5, 4 and 5; the nnmbers sp¬ 
read 4, 3, 2, 1 and 0. 

Observe that the condition for hi^ and Sg simply determines whether 
left-to-right maximnm pi^ does “intersect the jnmp-conhguration”, 
which consists of (7,9,12,13,5) in Fignre Recall that hi^ is the 
nnmber of entries to the right of pig which are smaller than pi^-, in 
order that pig is involved in a r-occurrence, the d entries which “canse” 
the jnmp mnst be among them, and there must be some entry left 
among them, which is not “used up” on the way to the jump. This 
consideration explains the sum in the lemma. 

In Figure |^, the numbers (hj^ — d — Sg) are 0,1, 2, 2,4; corresponding 
to no (3, 2, l)-occurrence involving the first left-to-right maximum 6, 
1 occurrence (8,7,5), two occurrences (10,9,5) and (10,7,5), another 
two occurrences (11,9,5) and (11,7,5), and finally four occurrences 
(14,13, 5), (14,12, 5), (14, 9, 5) and (14, 7, 5). □ 

Now we have the prerequisites ready for the remaining proofs. In 
the following, we will determine the subsets P (r, r) C D', which corre¬ 
spond bijectively to permutations with exactly r occurrences of r. More 
precisely, we will partition the set P (r, r) into subsets Pi,..., Pm ac¬ 
cording to some “pattern in the paths”, where all paths in Pi have the 
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Figure 9. Illustration for Lemma |T^. 
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same number st of down-jumps. Define the weight w {p) of a path in 
Dn^s to be (i.e., assign weight y/x to each up-step and each 

down-step; and weight 1 to each of the s down-jumps), and consider 
the generating function 

-Pr,r,i (x) :=^w{p), 

p 

where the summation runs over all p & Pi. Then the generating func¬ 
tion we are interested in is given as 

m 

FrA^)=Y,X-^^/^Pr,rA^)- (13) 

i=l 

3.3. The case of one occurrence of length—3—patterns. What 
we want to do is “assemble the respective lattice paths from appro¬ 
priate parts”, and “translate” this construction into the corresponding 
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Figure 10. The generating function for lattice paths 
“climbing up” from height 0 to height 4, which never go 
below the horizontal axis, is c® (\/^)^ = 



generating function. For convenience, we introduce the notation 


c = 


1 

2x 


^\/l - 4x 
2x 


for the generating function of ordinary Dyck-paths (without jumps). 

Observe that lattice paths from (a, 0) to (b, 1) {b > a, I > 0), which 
do not go below the horizontal axis, can be “composed” quite easily 
(see Figure 0, and that the respective generating function is 




(14) 


Now let us turn to our lattice paths with jumps: By Corollary |T^, for 
an arbitrary permutation p with exactly one occurrence of r = (3,1, 2) 
or r = (3,2,1), respectively, the paths '0r (p) must contain exactly 
one down-jump. Moreover, by Corollaries and |T^ or Lemma [1^, 
respectively, there must hold certain conditions on 


• down-steps before, 

• down-steps after, 

• and left-to-right maxima before 


this single jump. 

Let us start with a proof of (H): Observe that for any permuta¬ 
tion p with exactly one occurrence of r = (3,1,2), the path-segment 
around the jump must look exactly like //\|\/ by Corollaries 0 and 
1^. In turn, it is easy to see that all lattice paths with precisely one 
such “down-jump path-segment” and no other jumps correspond to 
permutations with precisely one occurrence of (3,1, 2). 
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So we can immediately write down the generating fnnction -^"( 3 , 1 , 2 ), 1 (x) 
we are interested in: 


^(3,1,2), l(^) = 

1=1 




//2^ 




4 

C X 


9 ’ 

c^x 


which coincides with (Q). (Here, the snmmation index I is simply to be 
interpreted as the height of the path-segment //\|\/.) □ 


Now we tnrn to the proof of (^. The conditions of Lemma imply, 
that in order not to have another left-to-right maximnm “intersect¬ 
ing” our jump (and thus introducing at least a second occurrence of 
r = (3,2,1)), there must be at least max(l,/) down-steps after the 
left-to-right maximum preceding the jump, where I is the height of 
the “valley” preceding this left-to-right maximum — expressed in our 
graphical notation, it is easy to see that we must have precisely the 


following situation |\/- k+2+zmax(i,i)+z .\|\/] (where z > 0 is an arbi¬ 
trary integer), at the end of which we are at height (A: -|- 1). Consider 
the generating function of the “lattice paths, starting from this path- 
segment up to the endpoint”: For / > 0, it is given as 


00 


E 


^(/c+5+/)/2 

1 — X 


^^+22,(^+1)/2 


^2^(/+6)/2 
(1 — cx)(l — x) 


(The summands are not simplihed on purpose, in order to make “visi¬ 
ble” the connection to the “path-segment”.) For / = 0, we have 

^2^7/2 

(1 — cx)(l — x) ’ 

Thus, we may write down immediately the desired generating function 
-^(3,2,1), l(^)- 


-^(3,2,1), l(^) “ 

a/x \ (1 - CX)(1 


X, 




i^+2^(^+l)/2 _ 


^2^(Z+6)/2 


C X 


1=1 


(1 — cx)(l — x) 

^3^3 ^^2^ _ ^ 2 : X) 

{i — x){i — cxy 


which coincides with (^. 


□ 


3.4. The case of two occurrences of length— 3— patterns. If a per¬ 
mutation contains exactly two occurrences of r, then the corresponding 
lattice path ipp (r) has one or two down-jumps (by Corollary |^. So 
we have to consider three cases for the “list of depths of jumps”, JT”: 
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Table 1. 312-bases and corresponding Dyck-paths 
with jumps for one and two occurrences 


Base p 

^312 (p) 

Reference in the text 

One occurrence: 

312 



Two occurrences: 

312645 

</ VV \A> 

a 

31524 

y\ y\ 

</ V ^A, 

b 

316452 


c 

3412 

yv^> 

d 

4132 

y\ 

e 

4213 

y\ 

\a> 

f 

423615 


g 

4312 


h 


• J = (1), i.e., there is precisely one jump of depth 1, (which is 
“responsible” for two r-occurrences), 

• J = (2), i.e., there is precisely one jump of depth 2, (which is 
“responsible” for two r-occurrences), 

• JT” = (1,1), i.e., there are precisely two jumps of depth 1 each 
(each of which is “responsible” for precisely one r-occurrence). 

As we shall see, the cases must be divided even further: However, 
we can make use of certain symmetries. 
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Table 2. 321-bases and corresponding Dyck-paths 
with jumps for one and two occurrences 


Base p 

^321 (p) 

Reference in the text 

One occurrence: 

321 



Two occurrences: 

321654 

</ VV NA> 

a 

32541 

y\ ^ 

</ V ^A, 

b 

326154 

/\ 

v vs, 

c 

3421 

ysA, 

</ SA, 

d 

421653 


e 

4231 

y\ 

/ \a. 

f 

426153 

A A 
/ ^ NA 

g 

4312 

A 

h 

52143 

v^, 

NA 

i 


Definition 20. For a permutation p G Sn, consider all entries that 
are involved in a r-occurrence. Assume that the length of the subword 
a formed by these entries is k, then there is a permutation p, E Sk with 
entries “in the same relative order” as the the entries of a: Call this 
permutation p the r-base of p. 
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Clearly, the r-base of p has the same number of occurrences as p it¬ 
self. For permutations with exactly one r-occurrence, the only possible 
r-base is r itself. 


Observation 21. For all r, the r-bases of permutations with exactly 
r T-occurrences are of length < 3r: In particular, for r fixed there is 
only a finite set of possible r-bases with r t- occurrences. 

It is immediately clear that the number of r-occurrences in some 
permutation p stays unchanged, if 

• The permutation graph G (p) is reflected at the downwards-sloping 
diagonal for both r = (3,1, 2) and r = (3, 2,1), 

• The permututation graph G (p) is reflected at the the upwards- 
sloping diagonal for r = (3, 2,1) only. 

Therefore, the generating function of permutations with some fixed t- 
base is the same as the generating function of permutations with the 
“reflected” r-base. 

Tables |] and || list all r-bases for 1 and 2 occurrences of (3,1,2) 
and (3,2,1), respectively. The lists were compiled by a brute-force 
computer search. 


3.4.1. r = (3,1,2), r = 2, J = (2). By the same type of considera¬ 
tions as in our proof of (^), we observe that permutations with exactly 
one jump of depth 2 and exactly two occurrences of r = (3,1, 2) are in 
one-to-one correspondence to lattice paths, where the “path-segment” 
around the jump looks exactly like 1 / //\ll\/7 ]. (The r-base corre¬ 
sponding to these permutations is (4,1,3,2); see Table |l| e.) We can 
immediately write down the generating function of such lattice paths: 


OO 

3.7/2 ^^Z+2^(Z+l)/2) 

1=1 



c^x^ 

1 — c^x 


(15) 


Here, the summation index I should be be interpreted as the height 
where the path-segment begins. The summands are not simplihed on 
purpose, in order to make visible the “composition” of the paths. 


3.4.2. r = (3,1,2), r = 2, J = (1). Recall the considerations for 
the proof of (^): There are exactly three ways to obtain precisely two 
occurrences from a single jump of depth 1, namely 

1. There is a second “peak” immediately preceding the jump, i.e., 
we face path-segment //\/\|\/' (r-base (3,4,1,2), see Table ^ 

d), 

2. There is a second down-step immediately before the jump, i.e., 
we face path-segment //\\|\/ (r-base (4, 3,1, 2), see Table h). 
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3. There is a second down-step immediately after the jump, i.e., we 
face path-segment //\|\\/ (r-base (4, 2,1, 3), see Table |l| f). 
The generating function for the permutations corresponding to the hrst 
case is xF (3 i 2 ),i(x): We simply have to “insert” another peak /\ im¬ 
mediately before the peak preceding the jump. 

For the second case, note that the path-segment //\\\\/ can be 
easily transformed into the path-segment //\/\|\/ of the first case 
(by replacing a “peak” by a “valley”), hence the generating function is 
a;^(3,i,2),i(^) again. 

For the third case, note that the r-base (4, 2,1, 3), when reflected at 
the downwards-sloping diagonal, gives (4,1,3, 2), which corresponds to 
one jump of depth 2: So the generating function must be the same as 


in (pjSD 


3.4.3. r = (3,1,2), r = 2, JT” = (1,1). We need a simple generalization 
of ([I^): The generating function of all lattice paths which 

• start at (a, k) for some a G Z and k > 0, 

• end at (6, 1) for I > k and b > a, 

• and do not go below the horizontal axis 

can be expressed in terms of c and x: 


Ck,l ■ ^ 




[{c^x) 


fc+l 




h=0 


C^X — 1 


(16) 


(To see this, interpret the summation index h as the minimal height 
reached by the respective path.) 

Now it is easy to write down the generating function for the set of 
lattice paths which do contain precisely two path-segments, connected 
by some arbitrary path-segment p\ 


//\|\/... some path p ... // \|\/| 


(the corresponding r-bases: (3,1, 2, 6,4, 5), (3,1, 5, 2,4), (3,1, 6,4, 5, 2) 
and (4, 2, 3, 6,1, 5); see Table |l| a, b, c and g). Using (p!6[) , we obtain: 


E 

1=1 


C^+1^F2^5/2 


y,k=l k=l-\-l / 

c^x^ (1 - 1 - c^x — c^x"^) 


(1 — c^x) 


,2^U 


( 17 ) 










PATTERNS IN PERMUTATIONS 


25 


3.4.4. All together. So we may deduce immediately 
^( 3 , 1 , 2 ), 2 ( 2 :) = 2a: 




2c^x^ c’x^ (1 + c^x — c^x^) 

+ ^ + - 


1 — c^x a: (1 — c^x) 


X (1 — c^x)^ 


4 4 
C X 


(1 — c^x)^ 

X (2 + 2c + cx — 4c^x — 4c^x + c^x^ + 2c^x^ + 2c®x^ — c®x^) 
which coincides with (|6f). □ 


Now we turn to r = (3, 2,1). 


3.4.5. r = (3, 2,1), r = 2, JT” = (2). By the same type of considerations 
as in our proof of (^, we observe that permutations with exactly one 
jump of depth 2 and exactly two occurrences of r = (3,2,1) are in 
one-to-one correspondence to lattice paths, where the “path-segment” 
around the jump looks exactly like \i/- k+2+z ./\. max(i,l)+z .\||\// ^ ^he 
end of which we are at height {k + 2) (the r-base corresponding to these 
permutations is (4, 3,1,2), see Table | h). Consider the generating 
function of the “lattice paths, starting from this path-segment up to 
the endpoint”: For Z > 1, it is given as 


For I 


For I 


00 


E 


^(/c+4+/)/2 

1 — X 


^^+3^(fcH-2)/2 


^ 3 ^(/+ 6)/2 

(1 — cx)(l — x) 


1, we have 


0, we have 


c3^9/2 

(1 — cx)(l — x) 


(1 — cx)(l — x) 


Thus, we may write down immediately the desired generating function 


c^x® 


(1 — cx)(l — x) 


+ c®x®/2 


.3^9/2 


C X 


(1 — cx)(l — x) 


E 

1=2 


.l+2^{l+l)/2^1/2 


^3^(l+6)/2 


C X 


(1 — cx)(l — x) 
c'^x® (1 — cx + c^x + c^x — c^x^) 


( 18 ) 


(1 — x)(l — cx)^ 
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3.4.6. r = (3,1,2), r = 2, J = (1). Recall the considerations for 
the proof of (H): There are exactly two ways to obtain precisely two 
occnrrences from a single jnmp of depth 1, namely 

1. There is a second “peak” which is “too near” before the jnmp (see 
Lemma |^; the corresponding r-base is (3,4, 2,1), see Table ^ d), 

2. There is a second down-step immediately after the jnmp, (r-base 
(4, 2, 3,1), see Table f). 

For the hrst case, note that the r-base (3,4, 2,1), when reflected at the 
npwards-sloping diagonal, is mapped to (4, 3,1, 2): Hence the generat¬ 
ing fnnction of this case is the same as in (pISl). 

The generating fnnction for the permntations corresponding to the 
second case is xF( 3 _ 2 ,i),i(x): We simply have to “insert” one np-step 
before the jnmp and one down-step after the jnmp in the path-segment 
we considered in the proof of (0); i.e, we mnst consider 


\1/. k+3+z max(l,l)+z .\|\\/ 


here. 

3.4.7. r = (3, 2,1), r = 2, J7 = (1,1). We want to determine the gen¬ 
erating fnnction for the set of lattice paths which do contain precisely 
the two path-segments in the following way 


. k+2+z ./\. max(l,l)+z . \|\/some path p ... \L/ ■ j+2+Z ./\. max(l,L)+Z . \|\/^ 


where p denotes some lattice path segment connecting the two path- 
segments. 

The corresponding r-bases are (3, 2,1, 6, 5,4) and (4, 2,1, 6, 5, 3); see 
Table ^ a and e. 

However, note that the “connecting path-segment” might be absent 
at all, i.e., we face the sitnation 


|\1 /. k+2+z ./\. max(l,l)+z . \|\k+l /. j+2+Z ./\. max(l,k+l)+Z . \|\/ 


(3,2, 5,4,1), (3, 2, 6,1,5,4), (4, 2, 6,1, 5, 3) and (5, 2,1,4, 3) are the 
r-bases corresponding to this case, see Table || b, c, g and i. 

The same considerations as before hnally lead to the generating fnnc¬ 
tion 

(1 — cx -1- (?x) 

(1 — x)^ (1 — cx)'^ 

X (2 — X — 2cx -I- c^x + cx^ -f- c^x^ -1- c^x^ — c^x^ — 


2c'^x^ -t- c^x^). 

(19) 
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3.4.8. All together. So, adding the respective generating fnnctions (pJ]), 
divided by x, and 2 times (p!8[) , divided by x, and (tF (3 2 , 1 ), i(t)) , we 
obtain 


(1 — x)^ (1 — cx)^ 

X ( 1+2 c—7cx —5 c^x+2 x+2 c^x+4cx^ + 16 x^ —10 c^x^—4 x^ 

— c x^ — 10 x^ — 9 x^ + 15 x^ + 14 c® x^ + 2 c® x^ + 2 x^ + 6 x^ 
—7 x'^—16 x*^—5 c® x"^—x^+c"^ x^+7 x®+4 c® x^—c^ x®—c® x®), 


which after some simplihcation coincides with (p!0[) . 


□ 
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